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SUMMARY  OF  RESEARCH 


The  research  supported  by  Grant  AFOSR-87-0087  has  been  primarily  concerned 
with  robust  signal  detection  and  estimation,  although  some  effort  has  also  been  directed 
toward  image  compression.  The  latter  research  area  will  be  addressed  first. 

A  recently  developed  technique  for  image  compression  is  Block  Truncation  Coding 
(BTC),  a  method  which  is  easy  to  implement  and  often  possesses  good  performance 
characteristics,  relative  to  other  approaches,  even  in  the  presence  of  many  channel 
errors.  In  addition,  the  BTC  algorithm  does  not  depend  on  knowledge  of  the  specific 
underlying  statisticzd  distributions  but  rather  on  sample  moments.  The  basic  BTC 
algorithm  employs  a  two  level  quantizer  whose  output  levels  are  obtained  by  matching 
sample  moments.  The  image  is  divided  into  blocks  of  pixels,  and  the  BTC  algorithm  is 
applied  block  by  block.  In  some  past  work  we  have  extended  the  basic  BTC  technique 
to  a  much  more  general  setting  which  admits  various  options  of  implementation  with 
the  potential  for  improved  performance.  In  our  current  work,  we  note  that  since  various 
particular  options  seem  most  appropriate  to  certmn  image  characteristics,  the  uniform 
application  of  one  specific  option  across  the  entire  image  (as  in  earlier  work)  may  not 
lead  to  best  performance.  Our  current  work  illustrates  an  adaptive  modification  of  the 
earlier  BTC  approach,  which  admits  adjusting  the  eilgorithm  on  a  block  by  block  basis. 
While  doing  so,  the  algorithm  chooses  among  various  optional  sample  moments,  as  well 
as  the  options  of  “black  on  white”  (higher  numbers  are  assigned  to  lighter  gray  levels) 
or  “white  on  black”  (higher  numbers  are  assigned  to  darker  gray  levels).  We  then  show 
by  example  that  such  block  by  block  adaptivity  can  lead  to  improved  performance.  Our 
work  also  shows  that  for  the  example  images  considered,  the  option  employed  across 
the  entire  image  by  the  basic  BTC  algorithm  is  chosen  by  the  adaptive  algorithm  for 
less  than  ten  percent  of  the  pixel  blocks,  thus  illustrating  the  appeal  of  our  adaptive 
approach.  These  results  are  delineated  in  #3  of  the  publication  list. 

A  major  thrust  of  our  effort  has  been  in  the  direction  of  robust  signal  detection. 
Some  of  our  work  has  employed  classiceil  saddlepoint  methodology  to  impaxt  robustness. 
In  some  recent  work  we  investigate  a  situation  where  inexact  knowledge  of  the  statistics 
of  the  noise  is  present  for  the  discrete  time  detection  of  signals  in  i.i.d.  non-Gaussian 
noise.  In  earlier  work  employing  the  canoniceil  form  of  the  locadly  optimal  detector, 
some  other  authors  showed  how  the  design  of  the  eisymptotically  robust  detector  for  the 
Huber- Tukey  mixture  family  of  noises  could  be  obtained.  As  might  have  been  expected. 
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the  results  led  to  censoring  the  factors  of  the  test  statistic  to  impart  robustness,  which 
led  to  the  employment  of  a  detector  nonlinearity  which  limited  observations  of  large 
magnitude.  However,  this  work  did  not  tzike  into  account  the  common  situation  where 
more  is  known  about  a  noise  density  near  the  origin  than  on  the  tails.  In  fact,  the  noise 
often  arises  in  practice  from  the  sum  of  a  number  of  “nearly”  independent  sources,  and 
thus  frequently  the  noise  density  resembles  the  Gaussian  near  the  origin  but  may  differ 
markedly  on  the  tails.  Such  knowledge  had  the  potential  to  be  exploited  for  improved 
performance,  where  the  robustness  is  imparted  to  account  for  our  lack  of  knowledge 
of  the  tails  of  the  noise  density.  We  have  investigated  this  opportunity  and  obtained 
results  which  specify  an  asymptotically  robust  detector  for  the  situation  where  the  noise 
density  is  known  on  an  interval  about  the  origin  for  the  case  where  the  signal  is  modeled 
as  a  random  process.  We  then  show  by  way  of  excimple  that  our  robust  detectors  offer 
improved  performance  over  the  previous  detectors;  in  fact,  the  improvement  is  quite 
dramatic  in  certain  cases.  These  results  are  delineated  in  ^2  of  the  publication  list. 

While  classical  saddlepoint  techniques  can  be  useful  in  investigating  certain  ques¬ 
tions  pertaining  to  robustness,  we  believe  that  the  exceedingly  heavy  reliance  placed 
by  researchers  on  these  techniques  stems  more  form  inertia  and  the  apparent  lack  of 
suitable  alternatives,  rather  than  a  universal  recognition  that  saddlepoint  techniques 
are  ultimately  suitable  in  all  important  respects.  In  our  recent  work,  a  desirable  al¬ 
ternative  has  been  developed  which  approaches  the  concept  of  robustness  through  a 
perspective  based  on  differential  geometry.  While  this  approach  has  found  application 
quite  naturally  to  robust  hypothesis  testing,  the  core  of  signal  detection,  the  approach 
also  has  the  advantage  of  possessing  the  potential  for  wider  domains  of  application.  The 
geometric  techniques  employed  allow  the  computation  of  a  quantitative  measure  of  the 
degree  of  robustness  of  a  given  detector  subject  to  a  wide  variation  of  the  underlying 
statistical  distribution  function  about  a  nominal  distribution.  This  new  approach  pos¬ 
sesses  distinct  advantages  when  compcired  to  classical  saddlepoint  criteria,  which  are 
inherently  nonquantitative  and  are  relevant  to  only  a  few  restricted  canonical  regions 
of  admissible  variation  about  a  nominal  distribution.  Moreover,  the  potential  sacrifices 
in  performance  implied  by  the  choice  of  a  classical  saddlepoint  robust  detector  may  be 
serious;  some  of  our  recent  work,  which  completely  specifies  the  classical  saddlepoint 
robust  detector  for  a  signal  in  nominally  Laplace  noise,  also  shows  that  substantial 
sacrifices  in  performance  are  experienced.  Our  approach  admits  an  analysis  based  on 
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the  quantitative  tradeoff  of  performance  and  robustness,  thus  providing  the  user  with 
a  much  more  flexible  design  procedure  than  that  based  on  the  classical  techniques. 

The  aforementioned  geometric  approach  has  been  introduced  by  us  in  esirlier  work 
and  has  provided  quantitative  measures  of  the  degree  of  robustness  for  both  the  local 
case,  where  the  results  have  application  only  for  small  neighborhoods  of  distributions 
neax  the  nominal,  and  the  more  general  nonlocal  case.  These  results  have  been  applied 
to  compare  the  robustness  of  a  Neyman-Pearson  optimal  detector  with  a  detector  which 
employs  a  censored  version  of  the  Neyman-Pearson  optimed  nonlinearity,  the  form  of  the 
latter  (hereafter  called  Huber-type)  arising  when  classical  saddlepoint  methodology  is 
utilized.  In  addition,  the  optimization  of  a  weighted  linear  cost  criterion  of  performance 
and  robustness  has  been  undertaken,  with  the  results  specifying  the  optimal  censoring 
height  of  the  detector  nonlinearity.  The  accomplishment  of  such  an  undertaking  would 
not  have  been  an  appropriate  goal  under  the  nonquantitative  classical  saddlepoint  de¬ 
sign  methods,  and  the  early  success  of  our  geometric  approach  in  addressing  such  goals 
has  encouraged  further  investigations. 

Because  our  earlier  results  have  disclosed  specific  disadvantages  as  well  as  advan¬ 
tages  of  the  Huber-type  detector,  we  have  recently  investigated  a  more  general  nonstan- 
daird  family  of  robust  detectors;  this  family  offers  a  more  varied  reuige  of  performance 
and  robustness  options.  Our  work  considers  both  the  local  aind  nonlocal  situation,  Eind 
we  show  that,  by  proper  choice  of  the  parameters  associated  with  the  nonstandard 
family,  a  much  richer  mix  of  performance  and  robustness  is  possible.  These  results  are 
delineated  in  of  the  publication  list. 

The  aforementioned  results  using  our  geometric  techniques  have  employed  an  as¬ 
sumption  of  i.i.d.  data.  While  in  some  cases  it  may  be  appropriate  to  employ  a  suffi¬ 
ciently  slow  sampling  rate  to  justify  an  assumption  of  independence,  it  is  precisely  in 
this  kind  of  circumstzince  that  stationarity  assumptions  become  less  credible.  We  there¬ 
fore  have  recently  considered  removing  the  stationarity  assumption  in  our  geometric 
approach,  and  we  have  found  that  results  analogous  to  the  i.i.d.  case  are  obtainable  for 
both  the  local  and  nonlocal  situation  if  one  assumes  independence  without  stationarity. 
One  particularly  interesting  consequence  of  these  results  is  that  for  many  of  the  exam¬ 
ples  considered,  the  Huber-type  robust  detector  becomes,  like  the  Neyman-Pearson 
optimal  detector,  completely  unrobust  as  the  number  of  samples  approaches  infinity. 
The  robustness  advantages  of  the  Huber-type  detector  thus  atrophy  and  approach  zero 
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for  large  numbers  of  samples,  increasing  the  appeal  of  alternative  nonstandard  families 
of  robust  detectors.  We  have  also  undertaken  an  accompanying  preliminary  study  of 
the  effects  of  dependency,  and  our  work  shows  how  a  measure  of  robustness  can  be  de¬ 
veloped  for  the  case  when  the  joint  distribution  function  is  parameterized  by  unknown 
parameters.  One  surprising  consequence  of  these  results  is  that  we  provide  an  example 
of  a  par2imeterized  Gaussian  family  of  joint  distributions  for  which  the  linear  detector 
is  more  robust  than  a  corresponding  censored  line£ir  (Huber-type)  detector.  Employ¬ 
ment  of  a  Huber- type  detector  may  therefore  do  more  harm  than  good  if  dependency 
is  expected,  and  thus  the  classical  robust  detector  is  not  at  edl  “robust”  to  possible  per¬ 
turbations  in  the  independence  a.ssumption.  We  also  have  investigated  more  general 
types  of  dependency,  and  our  work  shows  that  the  definition  for  the  robustness  measure 
which  is  analogous  to  the  corresponding  definition  in  the  independent  case  does  not 
lead  to  a  meaningful  result.  This  difficulty  arises  because  the  required  integrals  fail  to 
converge,  presumably  because  there  are  too  many  allowable  variations  in  the  multidi¬ 
mensional  distribution  functions  under  consideration.  A  modification  of  our  techniques 
for  the  general  dependent  case  would  thus  be  desirable.  The  aforementioned  results  are 
delineated  in  #4  of  the  publication  list. 

In  some  very  recent  work,  we  have  achieved  a  major  breakthrough  by  accomplish¬ 
ing  the  aforementioned  modification  of  our  techniques,  thus  admitting  application  to 
the  general  dependent  case.  Our  results  provide  a  natural  quantitative  measure  of 
the  robustness  of  a  signal  detector  with  dependent  data;  this  measure  is  sensitive  to 
essentially  arbitrary  perturbations  in  an  underlying  joint  distribution  away  from  the 
nominal.  Our  results  show,  for  example,  that  the  presence  of  residual  dependency  can 
result  in  a  reduction  of  robustness;  in  particular,  this  reduction  is  approximately  50% 
for  the  linear  detector.  Our  work  therefore  shows,  for  the  first  time,  precisely  how 
serious  the  consequences  of  residual  dependency  can  be.  These  results  are  delineated 
in  if  8  of  the  publication  list. 

In  some  other  recent  work,  we  have  shown  how  our  geometric  techniques  apply  to  a 
variety  of  signed  processors.  This  work  also  includes  results  for  measuring  the  robustness 
of  a  nonstandard  family  of  signal  detectors  featuring  nonempty  “negative  boundaries”. 
This  family  is  seen  to  offer  the  potential  for  enhanced  robustness  is  certain  situations 
over  standard  classical  saddlepomt  robust  detectors  and  other  detectors  possessing 
empty  “negative  boundaries”,  thus  opening  the  door  for  a  more  detailed  analysis.  These 
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results  axe  delineated  in  #6  of  the  publication  list. 

The  aforementional  work  involving  “negative  boundaries”  has  recently  been  ex¬ 
tended  by  us  to  include  a  comparison  of  the  standard  family  of  classical  robust  de¬ 
tectors  to  an  important  subfamily  of  the  aforementioned  nonstandard  family.  Using 
an  optimized  cost  criterion  that  reflects  the  contribution  of  both  performance  and  ro¬ 
bustness,  we  show  that  when  performance  is  emphasized  then  the  standard  family  is 
most  suitable;  however,  when  robustness  is  emphasized  then  the  nonstandard  family 
is  preferable.  Our  work  thus  allows  the  user  to  select  a  detector  which  most  closely 
matches  the  desired  performance/ robustness  mix.  These  results  are  delineated  in  ^7 
of  the  publication  list. 

Cur  current  work  also  is  directed  toward  the  area  of  robust  estimation.  We  have 
sought  to  apply  the  aforementioned  geometric  techniques  to  estimation  as  well  as  detec¬ 
tion,  and  we  have  shown  that  this  route  can  lead  to  success.  As  with  signal  detection, 
we  desire  a  quantitative  way  to  measure  the  degree  of  robustness  of  an  estimator  sub¬ 
ject  to  lack  of  knowledge  of  the  underlying  statistical  distributions.  There  appears  to 
be  more  than  a  passing  kinship  between  the  areas  of  signed  detection  and  estimation; 
both  have  optimal  forms  which  arise  under  Radon-Nikodym  derivatives,  and  both  have 
robust  forms  which  can  be  seen  to  arise  under  our  geometric  methodology.  We  have 
recently  undertaken  a  quantitative  einalysis  of  the  application  of  this  methodology  to 
robust  parameter  estimation,  where  genered  performance  measures  (including,  but  liot 
limited  to,  mean  square  error)  as  well  as  nonstationary  data  are  admitted.  Our  results 
show  not  only  why  cen.soring  again  can  be  helpful  in  imparting  robustness,  but  also 
how  limitations  involving  censoring  can  arise,  including  the  atrophy  of  robustness  for 
large  numbers  of  samples.  As  with  robust  signal  detection,  our  results  facilitate  the 
design  of  an  estimator  which  trades  off  performance  versus  robustness  subject  to  a  cost 
criterion  of  interest  to  the  user.  These  results  axe  delineated  in  ^5  of  the  publication 
list. 

In  conjunction  with  the  aforementioned  breakthrough  admitting  general  dependent 
data  in  signal  detection,  we  have  also  employed  analogous  modifications  to  our  work  in 
pzurameter  estimation  to  allow  measuring  the  robustness  of  an  estimator  of  a  random 
v^lriable.  Our  work  shows  that  the  choice  of  performance  fidelity  criterion  is  crucial. 
For  example,  we  find  that  for  many  popular  error  criteria  (e.g.  mean  square  error)  any 
admissable  estimator  is  completely  unrobust.  On  the  other  hand,  we  also  show  that 
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there  exists  a  wide  family  of  performance  criteria  for  which  some  degree  of  robustness 
can  be  achieved.  Somewhat  surprisingly,  in  this  case  the  best  estimator  has  been  shown 
by  us  to  also  be  the  most  robust.  The  conditional  expectation  estimator,  known  to  be 
an  optimal  estimator  under  a  variety  of  error  criteria,  thus  turns  out  to  be  either 
completely  unrobust  or  optimally  robust,  depending  on  the  choice  of  error  criterion. 
The  consideration  of  alternative  error  criteria  to  the  popular  mean  square  error  criterion 
is  therefore  highly  desirable.  These  results  are  delineated  in  #8  of  the  publication  list. 
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DIR  .CTION  OF  CURRENT  RESEARCH 


Current  rerec^ch  is  directed  toward  the  areas  of  robust  signal  detection  and  estima¬ 
tion,  using,  for  the  most  part,  nontraditional  approaches.  We  axe  especially  interested 
in  admitting  non-Gaussian  raxidom  processes  with  nonstationarity  and/or  dependency. 
^ ecause  traditional  approaches  have  leaned  heavily  on  i.i.d.  assumptions  when  studying 
robustness,  we  have  considered  the  alternative  of  applying  our  quantitative  geometric 
criterion  to  measure  robustness.  Our  recent  successes  in  admitting  dependent  data 
for  signal  detection  and  the  estimation  of  a  rcindom  variable  have  made  possible  the 
consideration  of  a  variety  of  related  problems,  including  the  design  of  nonstandard  de¬ 
tectors  as  well  as  the  consideration  of  nonstandard  estimation  error  criteria.  We  are 
also  considering  the  design  of  appropriate  suboptimal  schemes  which  appeal  to  the  user 
because  of  their  ease  in  implementation.  In  all  of  this  work  we  seek  results  for  nonlocal 
as  well  cis  local  robustness,  and  our  preliminary  results  are  encouraging. 


9 


